Self- Organized Short-Term Memories 



S.N. Coppersmith*, T.C. Jones*, L.P. Kadanoff*, A. Levine*, J.P. McCartent, S.R. NageP, 

S.C. Venkataramani*, Xinlei Wu* 
(February 1, 2008) 



Abstract 

We report short-term memory formation in a nonlinear dynamical system 
with many degrees of freedom. The system "remembers" a sequence of im- 
pulses for a transient period, but it coarsens and eventually "forgets" nearly 
all of them. The memory duration increases as the number of degrees of free- 
dom in the system increases. We demonstrate the existence of these transient 
memories in a laboratory experiment. 
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We present a deterministic nonlinear dynamical system with many degrees of freedom 
which self-organizes to store memories, in that a configuration-dependent quantity "learns" 
preselected values. The system, a simple discretized diffusion equation, encodes multiple 
memories during an extended transient period, but, in the limit of long times, retains no 
more than two of them. This system thus displays a mechanism by which memories are 
forgotten as well as learned. 

We demonstrate: (1) Short-term memories are exhibited by a system with two degrees of 
freedom, N = 2, and become more pronounced as N is increased. (2) The interval in which 
multiple memories are encoded typically grows as the square of the system's linear extent. 

(3) Many features of the dynamics, including their duration, can be understood analytically. 

(4) The mechanism is robust and is manifest in experiments on a sliding charge-density wave 
solid. 

Consider a system of coupled maps: 



Xj(r+1) = Xj (t) + int 



(1) 
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where i,j are the particle indices, the sum is over nearest neighbors, r is the time index, and 
int [z] is the largest integer less than or equal to z. These equations describe the evolution of 
the positions Xj of iV particles in a deep periodic potential, with nearest neighbor particles 
connected by springs of spring constant k <C 1, in the presence of force impulses (1 — A T ). 
They describe the dynamics of sliding charge-density waves (CDWs), and are closely 

related to models of a variety of dynamical systems. |3J The one- dimensional, r-independent 
version of this system (A T = A) has been studied previously 0|J(see also Ref. 0). Here, 
we consider A's which repeatedly cycle through M different values. 

The self-organization that occurs as these maps evolve is manifest in the discrete curva- 
ture variables ||, Cj(t) = kJ2i (nn)( x i( T ) ~ x j{ T ))-> which obey: 

Cj (r + 1) - Cj (r) = k £ {int [q(t) + (1 - A T )\ - int [ Cj (r) + (1 - A*)]} . (2) 

i (nn) 

Figure 1 shows normalized histograms of frac(c) = c — int(c) for a two-dimensional 
system with M = 5, periodic boundary conditions, and a random initial configuration of 



x's. Memory encoding is shown by the accumulation of c's with frac(c) = frac(y4 r ). For a 
while all M memories are encoded to a similar degree; eventually all are forgotten except 



Figure 2 shows the curvature variables Cj(r) versus time r for one- dimensional chains 
with one free and one fixed end: 



During the evolution, each Cj sticks at values corresponding to each A T . This tendency is 
more pronounced for N = 10 than for N = 2, indicating that larger systems encode transient 
memories more effectively. At the fixed point, only one memory (rather than two as in the 
model with periodic boundary conditions) is encoded. 

In CDW experiments, memory encoding is manifest as synchronization of the response 
to a repeated train of driving pulses so that V/I (V=voltage, I=CDW current, which is 
proportional to the CDW velocity vcdw) decreases just as each pulse ends. The correspon- 
dence between V/I and the c's is discussed in detail in Refs. Heuristically, it follows 
because Xj(r) can be thought of as the position of particle j after pulse r, and the int func- 
tions in Eqs. (1) arise because after each pulse every particle falls into the nearest potential 
minimum. The memory values are at the discontinuities of the the int functions, which for 
the highly overdamped dynamics relevant to CDW's [JJ means that many particles are at 
potential maxima at the end of a pulse. Since particles mounting the potential go slower 
than those descending it (again, implied by overdamped dynamics), when many particles 
have c's on memory values, then a preponderance of particles are at potential maxima, 
which in turn implies that the ratio vcdw/V is increasing at the end of each pulse. Sin- 
gle memory retention using identical pulses has been seen previously. [|7||| Here we report 
multiple memory encoding. || Figure 3 shows the successful training of a sample using 5 
different four-pulse sequences (current pulses). For this sample, we investigated 25 different 
four-pulse sequences and observed that the voltage response at the end of each pulse had a 





for all t 



(3) 
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negative slope (indicating the retention of a memory) 85% and a positive slope only 5% of 
the time. Thus, multiple memories are observed in experiments as well as simulations. 

To understand why the memories form, consider the "nailed" case of figure 2. Initially, 
each impulse causes every Xj to increment by the same amount, so that only the spring near 
the nail stretches. As time progresses, this spring stretches more and more, until the force 
it exerts becomes large enough to keep the first particle from going into the next well under 
application of A±, the impulse with the smaller fractional part. (At this point, the spring 
force is insufficient to change the action of A2, the impulse with the larger fractional part.) 
The second spring then starts to stretch, which, on the next iteration, gives just enough 
added force to restore the first particle to its initial motion for both impulses. So now the 
first spring stretches on alternate applications of the impulse A\, and the total spring force 
on particle 1 increments alternately by +k and —k. Therefore, C\ oscillates around the 
memory value A\, leading to a plateau on the plot of figure 2. Eventually the second spring 
is stretched to the point that the second particle also hangs up at the impulse A\. This, in 
turn, starts the stretching of the third spring, etc. A memory for A\ is created whenever 
the local curvature just cancels the fractional part of A\. A similar analysis holds for all the 
other impulses A T that are applied. As time progresses, the c's get stuck at all the different 
possible memory values. 

Another way to understand why the curvatures stick at the values of A T is to note 
that when Cj passes through a memory value, then the right hand side of Eq. (||D changes 
discontinuously, and in particular can change sign if the neighboring c's have the appropriate 
values. If this happens, then Cj oscillates with amplitude oc k, and sticks at the memory 



value. |10[ This sticking can take the form of either a fixed point or a cycle in the local 
c-values. 

For k — > 0, the dynamics separates into three regimes. The smallest motions are the 
O(k) back-and-forth motions at the memory values, which lead to minute serrations in the 
plateaus that are not visible on the scale of our figures. The largest motions, involving 
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changes in Cj which are larger than of order unity, and changes in r which are much larger 
than 1/k, are described by a linear discrete diffusion equation 

~ Cj ( T +l)-~c 1 (r) = k ECoiOO-CfCT)), (4) 

i (nn) 

obtained by linearizing the int functions in Eq. (||]). Figure 4, which shows snapshots of 
configurations at two different times, demonstrates the accuracy of the linearized equation 
in reproducing the evolution on large scales. Numerically, the maximum deviation between 
the solutions to Eqs. (0) and (§) for identical initial conditions, sup J)T \cj(r) — Cj(r)\, is less 
than unity for all system sizes, parameter values, boundary conditions, and initial conditions 
investigated. Using the nature of the nonlinearity in Eq. (Q) together with the fact that 
\z — int(z)| < 1 for all z, one can obtain a rigorous analytic bound on this difference that 
grows as log(L), where L is the system's linear extent, [jTT]] which is sufficient to insure the 



applicability of the memory duration estimates given below. 

Of course, neither of the regions just discussed produces the memory effects. The mem- 
ories come from an intermediate region involving variations in Cj much larger than k but 
smaller than unity. Figure 2 shows that, on this intermediate scale, all the c/s show a 
very simple behavior. They are either (1) stuck at one of the memory values, or (2) are 
between memory values, with the Cj varying linearly in time. This sequence of step-wise 
linear motions progressively reduces the variation in the discrete curvature of Cj. Thus, the 
intermediate and large scale motions of Cj can be described as different kinds of diffusive 
smoothing. 

To characterize how the memory durations depend on system parameters, first consider 
the case when the number of memories M = 1. The onset time r onset is determined by the 
condition that the curvature of the curvature V 2 c is ~ 1. This condition follows because 
the c's stick only when the discontinuity in the integer function is large enough to cause the 
right hand side (rhs) of Eq. (fj) to change sign. For multiple memories, we sum the rhs of 
Eq. (0) over the M terms in the cycle and note that the discontinuity occurs in only one 
of M terms in the sum, leading to the condition V 2 c ~ 1/M. For any M, the transient 



memories disappear when the range of curvatures becomes too small, 5c = c max — c m i n ~ 1. 
To relate the onset and forgetting times to these conditions on the curvatures, we use the 
linearized map Eq. whose evolution obeys (when r ^> l/k): 



V) = £ e^c(g, r = 0)e- fe ^ , (5) 

where c(q,T = 0) is the spatial Fourier transform of the initial condition cj(t = 0). For 
the random initial conditions for c shown in figure 3, V 2 c is dominated by q ~ \fkr and 
the onset time r onset ~ coM/k, where cq is a typical value of c(q,r = 0), independent of 
the linear extent L. At long times Sc is dominated by the longest wavelength mode, so that 
T forget ~ i^fc m ( c o)- Thus, larger systems remember longer. 

The system of Eqs. (0) is deterministically driven towards a fixed point. Once this point 
is reached, it is impossible to retrieve the short-term memories. However, it is possible to 



keep the transient memories from decaying by adding noise to the system. |12| For example, 
in the "nailed" case of Figure 2, moving the nail slowly but randomly with time creates the 
possibility of continuously encoding new memories. That noise can lead to the retention of 
memories is important for understanding our experiments. Permanently encoded multiple 
memories are observed, but only in samples of NbSe^ with additional conducting strips 
attached to the crystal between the contacts, an arrangement known to induce noise. fl3| 



Our memory mechanism can be compared to the "Hopfield memory," [14 which is a 
dynamical system with parameters adjusted so that particular configurations, which encode 
the desired patterns, minimize an energy functional. There, the memory is encoded in the 
long-time dynamics, and there is no intrinsic "forgetting" mechanism. Moreover, changing 
the remembered value requires nontrivial adjustment of the microscopic couplings of the 
model. In the CDW system studied here, the information is encoded in an evolving system, 
the control parameter (pulse size) is easily varied in the laboratory, and the self-organization 
is exhibited via standard transport measurements. 

One avenue for further investigation is to characterize better the effects of noise, which, 
as discussed above, plays an important role in the CDW experiments. We would also like 
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to identify other experimental systems which exhibit this short-term memory. Because the 
present model is just a discretized diffusion equation, having properties which seem quite 
robust, we are optimistic that physical embodiments exist that could be made into useful 
devices. 

We thank S.E. Brown, P.B. Littlewood, M.L. Povinelli, and R. Thorne for fruitful dis- 
cussions. This work was supported in part by the MRSEC program of the National Science 
Foundation under award number DMR-9400379. A.L. acknowledges support by an AT&T 
Graduate Fellowship. 
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Figure 1: Memory formation of Eq. (|I|) in a two-dimensional 100 x 100 system with 
periodic boundary conditions, k = 0.0001, initial condition of x's chosen randomly from the 
interval [0, 1000000], and M = 5 {A = [0.1,0.35,0.5,0.75,0.92]). P is the proportion of c's 
with fractional parts frac(c) within a bin of width 0.002. For clarity, successive curves are 
offset vertically. The lower panel illustrates the short-term accumulation of c's at each value 
of A; the upper panel demonstrates that at long times only two peaks persist. 
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Figure 2: Plot of curvatures Cj(t) versus r for iV-particle chains with fixed-end boundary 
conditions Eq. k = 0.001 and A = [9.3, 9.6], and initial condition Xj(r = 0) = for all j. 
The memories are manifest in the plateaus (more pronounced for iV = 10 than for N = 2) 
when the Cj have values with fractional part of 0.3 and 0.6. Only one memory is retained 
at long times. 
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Figure 3: Trained voltage response curves of NbSe 3 for five different four-pulse sequences. 
The evidence for multiple-memory encoding is the decreasing magnitude of the voltage at 
the end of each pulse. (Note the two pulses have opposite signs. The voltage response for 
pulses 3 and 4 are not shown.) The drive is a sequence of 4 current pulses with magnitudes 
[/,—/,/,—/] and durations 2.95, 2.05, 1.75, and 2.75 fis. The drive magnitude, /, is 20.76, 
21.16, 21.55, 21.94, and 22.33 /iA for curves A, B, C, D, and E, respectively. Training con- 
sisted of over one million pulse repetitions. Measurements were performed using a two-wire, 
silver-paint contact configuration. Sample dimensions are 5.2 /im 2 x 980 fim. Additional 
silver paint strips of 43 \xm and 100 fim in width are attached to the sample, centered at 
distances 13% and 58% between the probe contacts respectively. The curves are offset for 
clarity, and averaged 200 times to reduce noise. T = 50f^, and E T = 47 mV/ cm. 
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Figure 4: Snapshots of curvature Cj versus position j of a one-dimensional chain of length 
L=400 with periodic boundary conditions at (a) r = and (b) r = 1200000. (The fixed 
point is reached at r ~ 9300000.) Parameter values are A = [1.1,1.5,1.7], k = 0.001. 
The dashed line in (b) is the configuration obtained using Eq. (f|) with the same initial 
conditions, demonstrating that this linear diffusion equation captures accurately the large 
scale evolution of the system. 
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